WORLD INTELLECTUAL PROPERTY ORGANIZATION 
International Bureau 




PCX 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification ^ 
G06F 13/40, H03M 9/00 



Al 



(11) International Publication Number: WO 97/48056 

(43) International Publication Date: 18 December 1997 (18.12.97) 



(21) International Application Number: PCT/US97/106I I 

(22) International Filing Date: 13 June 1997 (13.06.97) 



(30) Priority Data: 

08/664 J 36 



14 June !996 (14.06.96) 



US 



(71) Applicant: SILICON IMAGE. INC [US/USJ; Suite 222, 1032 

El we II Court. Palo Alto. CA 94303 (US). 

(72) Inventors: KIM. Sungjoon; 5-1107 Mujigae ApL, Scocho- 

dong, Seocho-gu. Seoul (KR). LEE. David, D.; 3715 
Redwood Circle. Palo Alto, CA 94306 (US). JEONG. Deog- 
Kyoon; 3351 Alma Street #307, Palo Alto. CA 94306 (US). 

(74) Agents: OKAMOTO, James. K. ct al.; Fcnwick & West LLP, 
Suite 700. Two Palo Alto Square, Palo Alto. CA 94306 
(US). 



(81) Designated States: AL. AM, AT, AU. AZ. BA, BB. BG. BR. 
BY, CA, CH. CN, CU. CZ. DE. DK. EE. ES. Fl. GB. GE. 
GH. HU. IL. IS. JP. KE. KG, KP, KR. KZ, LC. LK. LR, 
LS. LT, LU. LV. MD. MG, MK, MN. MW, MX. NO, NZ. 
PL, PT, RO. RU. SD. SE. SG. SI, SK, TJ. TM. TR, TT. 
UA, UG. UZ, VN, YU. ZW, ARIPO patent (GH, KE, LS, 
MW, SD. SZ. UG. ZW), Eurasian patent (AM. AZ, BY. 
KG. KZ. MD. RU. TJ. TM). European patent (AT, BE. CH. 
DE, DK. ES. Fl. FR. GB. GR. IE, IT. LU. MC, NL. PT, 
SE). OAPI patent (BF, BJ, CF. CG. CI. CM. GA. GN. ML, 
MR, NE. SN. TD. TG). 



Published 

With international search report. 

Before the expiration of the time limit for amending the 
claims and to be republished in the event of the receipt of 
amendments. 



BEST AVAILABLE COPY 



(54) TiUe: A SYSTEM AND METHOD ¥GR SENDING MULTIPLE DATA SIGNALS OVER A SERIAL LINK 




_ Prtmsry 






Ma 




I. 




30b 


, ThW 




• SIgnBl 


I.: 


• 




• 


• 


• 


• 


• 




^ Nth 




* Signal 


30n 





Clock 



(57) Abstract 

A system and method for sending multiple data signals over a serial link comprises an embedding unit and a removing unit coupled by 
a serial line. The embedding unit preferably receives a plurality of data streams, encodes the data streams and then merges the encoded data 
into a serial stream that is output across a serial line to the removing unit. The removing unit receives a serial stream of data, decodes the 
serial stream, and then separates the decoded serial stream into separate streams thereby reconstructing the streams input to the embedding 
unit. The encoding and transmission by the embedding unit and the receipt and decoding by the removing unit arc completely transparent, 
the signals output by the removing unit are identical in timing and data content to the signals input to the embedding unit. The present 
invention also includes a method for transmitting a plurality of data streams over a signal line, and a method for generating a plurality of 
data streams from a serial sequence. 
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SYSTEM AND METHOD FOR SENDING MULTIPLE DATA SIGNALS OVER A 

SERIAL LINK 



Cross-References to Related Applications 
The present application is a continuation-in-part of U.S. Patent Application 
Serial No. 08/ , entitled "High-Speed Digital Video Signal Transmission 

10 System," filed on March 27, 1996, which is incorporated herein by reference; a 
continuation-in-part of U.S. Patent Application Serial No. 08/539,816 entitled 
"Transition-Controlled Digital Encoding and Signal Transmission System/' filed on 
October 5, 1995, which is incorporated herein by reference; and a continuation-in-part 
of U.S. Patent Application Serial No. 08/ entitled "System And Method for 

15 High-Speed Skew-Insensitive Multi-Channel Data Transmission," filed on , 

1996, which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
1. Field of the Invention . 

20 The present invention relates generally to digital communications and interface 

devices in computer systems. In particular, the present invention relates to a system 
and method for sending multiple data signals or streams over a serial line. Still more 
particularly, the present invention relates to a system and method for sending an 
isochronous data stream and one or more additional data streams over a serial link. 

25 2. Description of the Backeround Art . 

The use and proliferation of computers is well known. Recently, however, the 
use of computers for multimedia applications has drastically increased. Especially in 
the area of desktop computing, new multimedia applications (such as editing full 
motion video, still pictures, sound clips as well as other programs that combine audio 

30 input/ output and video input/ output) are demanding increasing computing power 
and bandwidth from interconnection resources. For example, a primary area where 
more bandwidth is needed is in the connection of computer svstems to display devices. 
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The standard resolution for graphics, even in the desktop environment, has 
dramatically increased the density of pixels as well as the number of colors and shades 
of gray. The bandwidth requirement for high resolution displays is extremely high, so 
high that t>'pical interconnect systems are dedicated to refreshing the display data 
stream such that the entire data channel is available only to carry display video and 
control data. Furthermore, the blanking time required by certain display types (e.g. 
CRTs), makes a part of the avaUable bandwidth not usable. Thus, there is a need for a 
digital communications interconnect structure that can provide the desired high speed 
and bandwidth. 

A common approach to satisfying the increases in the required data transfer 
rates has been to increase the number of paraUel lines used in interconnect structures. 
However, this approach has a number of shortcomings. First, increasing the number of 
parallel lines requires increased amounts of space for the interconnect structures such 
as connectors in addition to the increase in materials for signal lines and cables. 
Second, increasing the number of paraUel lines increases the number of input/output 
pins for integrated circuits which further heightens an existing problem because of the 
computational capacity being added to such integrated circuits and the corresponding 
need for more input/ output pins. Third, increasing the number of parallel lines and 
sending data at high speeds over such lines creates additional problems in the form of 
electro-magnetic interference. Thus, the addiHon of more parallel signal lines cannot 
satisfy the need for additional bandwidth. 

Therefore, there is a continuing need for a simple and reliable system and 
method for transmission of data at a high-speeds. This system and method should not 
require extensive hardware and be adaptable to a variety of different isochronous 
signals and data stream combinations that may need to be sent over a serial line. 

SUMMARY OF THF TMVENTION 
The present invention overcomes the deficiencies and limitations of the prior art 
with a serial link system and method for sending an isochronous data stream and one 
or more additional data streams over a single serial line. The preferred embodiment of 
the serial link system advantageously eliminates the aforementioned problems with 
numerous high speed parallel data lines and is able to provide high speed data transfer 
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at rates in excess of that needed for high resolution displays. The preferred 
embodiment of the system of the present invention comprises an embedding unit and a 
removing unit coupled by a serial line. The embedding unit preferably receives a 
plurality of data streams, encodes the data streams and then merges the encoded data 
5 into a serial stream that is output across a serial line to the removing unit. The 
removing unit receives a serial stream of data, decodes the serial stream, and then 
separates the decoded serial stream into separate streams thereby reconstructing the 
streams input to the embedding unit. 

The embedding unit preferably comprises an encoder, a data buffer, a control 

10 code generator, a scheduler, a multiplexor and a parallel-to-serial converter. The 
encoder receives a plurality of data streams v^hich it respectively encodes. The 
encoded signals are stored temporarily in the buffer if necessary before being sent to 
the multiplexor. The control code generator creates and provides to the multiplexor 
control code signals necessary for decoding and separating the multiple streams being 

15 merged for transmission over the serial line. The scheduler is coupled to receive the 
output of the encoder and is coupled to control v^hich of the streams applied at the 
inputs of the multiplexor will be output to the parallel-to-serial converter. The 
parallel-to-serial converter receives parallel bits from the multiplexor and the converts 
them to a serial stream send on the serial line. 

20 The removing unit preferably comprises a serial-to-parallel converter, a stream 

selector, a de-multiplexor, a data buffer and a decoder. The serial-to-parallel converter 
is coupled to the serial line to receive the serialized signal from the embedding unit. 
The serial-to-parallel converter preferably converts each word sent on the serial line to 
parallel form, and outputs the v^ord to the stream selector and the de-multiplexor. The 

25 stream selector identifies v^ords that are control characters and then controls the de- 
multiplexor so that the data output by the serial-to-parallel converter is routed to the 
corresponding input line of the decoder. The decoder receives each v^ord from the de- 
multiplexor and decodes the word to restore it to its original form prior to encoding 
and transmission across the serial line. 

30 The present invention also includes a method for transmitting a plurality of data 

streams over a signal line, and a method for generating a plurality of data strean\s from 
a serial sequence. The method for transmitting a plurality of data streams over a signal 
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line preferably comprises the steps of: receiving a first data stream and a second; 
encoding the first and second data streams into coded words; transmitting a first 
control code over the signal line; transmitting the encoded words of the first data 
stream over the signal line; transmitting a second control code over the signal line; and 
transmitting the encoded words of the second data stream over the signal line. The 
method for generahng a plurality of data streams from a serial sequence preferably 
comprises the steps of: converting a serial sequence of bits into a word; comparing the 
word to a set of predetermined control characters; routing the word to a decoder 
according to the predetermined control character; and decoding the word. 



BRIEF DE5CRT PTION OFTHt: DRAWTNaq 
Figure 1 is a block diagram of a preferred embodiment of a svstem of the 
present invention for sending and receiving multiple data streams over a serial link; 

Figure 2 is a block diagram of a first embodiment of the embedding unit of the 
system constructed according to the present invention; 

Figure 3 is a block diagram of a second embodiment of the embedding unit of 
the system constructed according to the present invention; 

Figures 4A and 4B are a timing diagram showing a clock signal, two stream 
signals input to the embedding unit and a serial output of the embedding unit- 
Figure 5 is block diagram of an embodiment of a video decoder for the second 
embodiment of the embedding unit constructed according to the present invention; 

Figure 6 is block diagram of a preferred embodiment of a scheduler for the 
embedding unit of the present invention; 

Figure 7 is a block diagram of a first embodiment of the removing unit of the 
25 system constructed according to the present invention; 

Figure 8 is a block diagram of a second embodiment of the removing unit of the 
system constructed according to the present invention; 

Figure 9 is block diagram of an embodiment of a stream selector for use in the 
second embodiment of the removing unit- 
Figure lOA is schematic diagram of an embodiment of a word aligner of the 
removing unit of the present invention; 
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Figure lOB is schematic diagram of an embodiment of an idle character detector 
of the word aligner of the present invention; 

Figure 11 is a block diagram of a third embodiment of the removing unit of the 
system of the present invention including a bubble buffer; 
5 Figure 12 is a block diagram of a preferred embodiment of a data selection 

controller for the bubble buffer of the third embodiment of the removing unit; 

Figure 13 is a block diagram of an exemplary embodiment of the idle word 
detector of the data selection controller according to one embodiment of the present 
invention; 

10 Figure 14 is a block diagram of an exemplary embodiment of the isochronous 

word detector of the data selection controller according to one embodiment of the 
present invention; 

Figure 15 is chart showing the operation of the bubble buffer of the third 
embodiment of the removing unit; 
15 Figure 16 is a block diagriim of a third embodiment of the removing unit of the 

system of the present invention including a bubble buffer; 

Figure 17 is a timing diagram shov^g a dock signal, two stream signals, a 
control signal and a serial stream wherein the video refresh data has been divided into 
blocks; and 

20 Figures 18A and 18B are block diagrams showing exemplary bi-directional 

communication system constructed using the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Referring now to Figure 1, a block diagram of a preferred embodiment of a 
25 serial link system 20 for sending an isochronous digital data stream and one or more 
additional digital data streams over a single serial line is shown. The serial link system 
20 of the present invention preferably comprises an embedding unit 22, a removing 
unit 24, a single serial line 28 and a clock signal line 32. This invention basically is a 
rime mulrtplexed data transfer in a serial digital interface, for example a display 
30 interface. In a conventional parallel digital display interface, there are parallel video 
data refresh signals for each color (Red, Green, Blue) and video control signals 
(HSYNC, VSYNC, DE). However, in the present invention, multiple content of data 
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Streams as well as all video control signals, such as HSYNC, VSYNC. DE, are also sent 
through display data channels by employmg line coding. While the preferred 
embodiment of the present invention will be described below in the context of a system 
that timeshares a serial data and clock line between four digital signals or streams' 
those skilled in the art will realize the present invention may be applied to a svstem 
havmg any number of streams from two streams to n streams. 

The embedding unit 22 preferably has a plurality of inputs and a first and 
second outputs. Each of the plurality of inputs zs coupled to a respective input signal 
Ime 26a, 26b, 26c, 26n to receive a primary signal, preferably a v.deo signal, a second 
signal, a third signal and a nth signal. Each of the inputs and corresponding mput 
signal lines 26a, 26b, 26c, 26n is a plurality of signal lines. For example, the primarv 
signal hne may be a video signal that has 8 signal lines for data (8 bits of Red, 8 bits of 
Green. 8 bits of Blue in sequence) and signal lines for a control signals (horizontal svnc 
vertical sync and other control signals); and the second signal may be an eight bit data 
signal requiring eight signal lines. Those skilled in the art will realize that the pnmarv 
signal, second signal, third signal and nth signal may each require different numbers of 
signal lines and that a variety of combinations may be possible. The embedding unit 
22 receives the primary signal, second signal, third signal and nth signal, and encodes 
each signal. Then the embedding unit 22 combines the encoded signals and inserts 
separation signals or characters for idenhfying the input signal from which the 
encoded signals were derived. The combination results in an encoded serial sequence 
that IS output on the first output for transmission over the serial line 28. The second 
output of the embedding unit 22 provides a clock signal used to synchronize the 
transmission of the encoded sequence. 

The removing unit 24 preferably has an first input, a second input and a 
plurality of outputs. The first input of the removing unit 24 is coupled to serial line 28 
to receive the encoded serial sequence from the embedding unit 22. The second input 
of the removing unit 24 is coupled to clock line 32 to receive the clock signal from the 
embedding unit 22. The removing unit 24 separates the encoded serial sequence into 
separate signals, removes the separation characters and decodes the separate signals 
which are each output on a respective output of the removing unit 24. Each of the 
outputs of the removing unit 24 is coupled to a signal line 30a, 30b, 30c, 30n to output 
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the reconstructed the primary signal, second signal, third signal and nth signal, 
respectively. Like the input signal lines 26a, 26b, 26c, 26n, each of the output signal 
lines 30a, 30b, 30c, 30n may be a plurality of signal lines. For example, the output 
signal lines 30a may be 25 parallel lines, the other output signal lines might be eight 
parallel lines. The present invention advantageously makes the embedding, 
transmission over the serial line 28 and clock line 32, and decoding appear completely 
trzinsparent such that the signals applied to lines 26a-n are identical in content and 
relative timing to the signals that appear on the output lines 30a-30n. 

Referring now to Figure 2, a first and preferred embodiment of the embedding 
unit 22 is shown. The embedding unit 22 preferably comprises an encoder 40, a data 
buffer 42, a control code generator 44, a scheduler 46, a multiplexor 48 and a parallel- 
to-seriai converter 50. For convenience and ease of understanding, the clock signal is 
shown as being input to scheduler 46 and output by the scheduler 46 on line 32. Those 
skilled in the art will realize that the clock signal is also applied to the other 
components of the embedding unit 22 in a conventional manner. The embedding unit 
22 mixes various data streams into a single serial data stream. The present invention 
will now be discussed in the context of mixing various multimedia data streams into 
the display refresh data (primary stream) using the unused bandwidth of horizontal 
and vertical blanking periods. Possible multimedia data streams that can be mixed 
include, but are not limited to audio I/O, keyboard and mouse, PC bus (serial bus for 
peripheral components), Universal Serial Bus and P1394 data. The separation between 
data streams is done by inserting special characters defined in a line coding scheme. 
By exploiting the available bandwidth of current high speed serial links, the present 
invention advantageously can send the coded stream such that embedding of multiple 
data streams is possible. In general, the embedding unit 22 receives a plurality of data 
streams. For each of the data streams, n bits of information to be tramsmitted are 
encoded to k bits, where k is larger than n, and then sent serially bit by bit over the 
serial line 28. 2^ data words can be defined using k bits. Since 2*^ data words 
represented by n bit parallel data streams can be mapped into a subset of the 2*^ data 
words, 2^ - 2" data words remain after mapping for use as special codes. Once the 
parallel streams have been encoded into k-bit words and other control words are 
created and inserted, the encoded words and control words are multiplex and serially 
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sen. on line 28 one bi, a. a tae. Fo. ease of understanding, the present invention will 
now be described in the context o, encoding from eight bits to 10 bits, and decoding 
from 10 bits to eight bits although those skilled in the art will re„,g„ize that the present 
invention may be used for various other coding rates. 

5 ^"-"''-''"P^^e-blyhasaplurali.yofinputsandaplural.tvofoutputs 
n>e » of inputs are preferably grouped in sets. TT,us, ■„ Figure 2. signal lines' 
26a, 26b. 26c, . . . 26n are each used to designate one or more signal lines of a data 
stream. For example, the first primary stream is preferably a video stream includmg 
he data and control signals for display refresh and may for example, be 28 parallel 
10 imes, 24 for data and 4 for control. The remaining s,g„a, lines 26b, 26c. . , . 26n can be 
used for other types of data, and are for example, each eight parallel lines. T„ose 
sWled in the art wil, realize that each signal Une 26a. 26b, 26c, .. . 26n mav be a varietv 
of parallel signal lines. For each of the input signal lines 26a. 26b, 26c. . . 26n the ' 

^-"•'"^P-'erably provides a correspondirig output Signal line 52a, 52b. 5^, 
52.. Each of the output signals line 52a, 52b, 52c, .. . 52n provides the encoded output 
of t^e Signal applied to the corresponding input of the encoder 40, .n the exemplary 
embodiment, the present invenHon uses an encoding ^heme that encodes eight bits of 
data m» a corresponding encoded 10-bit word. Thus, each of .he output signals line 

coupled by line 52a to an input of the multiplexor 48. The remaining output lines are ' 
52b o2c. . . . 52n are coupled to respecHve inputs of the data buffer 42. The encoder 40 
preferably encodes the input stream into ,0-bit output streams. Tlte word output by 
*e encoder 40 are preferably any llVbi, words other than those identified in Appendix 
A as spectal code words used as IDI^ characters, isochronous data trar^fer characters 
datastreamseparaHoncharacters.andlinkshutdowncharac.ers. Anynumberof 
convenHonal eight to ,0 encoding schemes may be used in addition to the specific 
encoding scheme idenHfied below wi.h respect to Figure 5. 

TT>e data buffer 42 has a plurality of inputs and a plurali.y of outputs. Each of 
the mputs is coupled by a respective signal line 52b. 52c. . . 52n to the outputs of the 
30 encoder 40. The encoded primary stream output by the encoder 40 on line 52a has 

priority in being multiplexed and transmitted serially, and therefore. . no, buffered bv 
the da.a buffer 42. However, the remaining encoded data streams output on lines 52^. 
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52c, . . . 52n may not be immediately usable by the multiplexor 48 and must be 
buffered. The data buffer 42 essentially stores the encoded words for the second 
through nth data streams until they can be inserted into portions of the serial channel 
not used by other streams. The data buffer 42 is preferably sized such that for each of 
5 the streams, it can hold n words, where n is the number of streams. This ensures that 
the data buffer can temporarily store data in the event it does output data from its 
corresponding steam to the serial link 28 except for every n clock cycles. The outputs 
of the data buffer 42 are coupled by a respective signal lines 55b, 55c, . . . 54n to the 
corresponding inputs of the encoder multiplexor 48. The data buffer 42 is also 
10 coupled to the scheduler via line 62 to receive control signals, as wUl be described in 
more detail below. 

The control words used to separate data streams and for other control functions 
are provided by the control code generator 44. In the preferred embodiment, the 
control code generator 44 is a series of hard wired word or character values the each 

15 are coupled to a respective multiplexor input. The present invention provides a 

unique control and separation scheme in which four categories of special or control 
words are used. An exemplary set of control words are provided in Appendix A. The 
first type of control word is the IDLE word. The IDLE word is transmitted over the 
serial link 28 when there is not data from any of the data streams to be sent. The 

20 purpose of the idle word is to make enough transitions during preamble period so that 
the receiving circuit can obtain bit synchronization and to make the word 
synchronization easy. The second type of control word is the isochronous data transfer 
word. These control words indicate the transfer of time critical data such as timing 
control signals of video or other data. The isochronous special word can be sent at any 

25 time without interfering with the other streams. The third type of control word is a 
data stream separation word, which separates between multiple contexts of data 
streams and indicates the start or end of a certain type of data transfer. The fourth type 
of control word is the link shut down word, which is used when the embedding unit 
22 shuts down and to let data recipients to know the end of data transmission. If the 

30 removing unit 24 receives link shutdown character, it can go into power down mode or 
idle state. Any special character selection which satisfies above conditions can be used 
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for this inventior.. As have been noted above, a preferred implementation for the above 
encoding scheme is an 8bit/10bit encoding. 

A selection of special characters for the 8bit/ lObit encoding scheme wUl now be 
described in detail. The coding scheme advantageously makes the separation between 
normal data words and special control words easy, and thus leads to a great reduction 
of circuits. The present invention preferably divides special control words from 
normal data words by the number of transitions in a word frame. Since there are over 
a fbced number of transitions within a word frame, the frame can be classified into a 
special control word using only a simple counter and a comparator. Any special 
control word selection which satisfies the above conditions can be used for this 
invention. Appendix A shows an example selection of special control words for an 
8bit/10bit encoding. In a 10 bit word boundary there can be as many as 9 data 
transitions. A word which has either more than 6 data transitions or 0 transitions 
within the word boundary is classified as a special control word. 

The IDLE word preferably has the following characteristics. First, it has enough 
tiransitions for the removing unit 24 to obtain bit synchronization. Second, it is shift 
invariant for word synchronization. Third, it has an equal number of logical one bits 
and logical zero bits on average. Such balanced patterns are desirable, for example, 
when the signal path in the serial link 28 must include transformers for prevention of 
ground loops and common mode signal propagation. The 4 words shown in 
Appendix A, which have 8 data ti-ansitions within a 10 bit frame and are DC free and 
shift-invariant for each other, are defined as IDLE words. Anyone of the 4 words can 
be used. The inverted versions of the IDLE words can also be used. Word 
synchronization can be obtained easily by using these Words. If there are more than 15 
data transitions within 2 frames, the receiver will obtain word synchronization. 

Words with 6 data h-ansitions are used as isochronous data transfer words and 
the data stream separation characters. Words starting with '0' and having 6 data 
ti-ansitions are used for isochronous data transfer. Words starting with V and having 
6 data transitions are used for data sti-eam separation information. 

Words without a ti-ansition within its word boundary is used as link shut down 
characters. 
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Words which have from 1 to 5 data transitions are used as normal data 
characters. 

As shown in Figure 2, the scheduler 46 is responsible for controlling the data 
buffer 42 and the multiplexor 48. The scheduler 46 preferably has a plurality of inputs 
coupled via lines 52a, 54b, 54c . . . 54n to receive the encoded words from the encoder 
40 and the data buffer 42. The scheduler 46 has a first and a second output coupled 
vial lines 62 and 58, respectively to the data buffer 62 and the multiplexor 48. The 
scheduler 46 also has two additional inputs; a first input coupled to receive a clock 
signal, and a second input coupled via line 66 to receive control signals sp)ecifying 
whether to start up or shut dovm the serial link 28. The scheduler 46 controls which 
encoded signals are sent from the multiplexor 48 to the parallel-to-serial converter 50. 
The scheduler 46 preferably controls the signals output by the multiplexor 48 
according to the following rules. 

1) The isochronous data transfer words are input into the data 
stream output by the multiplexor 48 when receive and have the highest 
priority; 

2) The encoded primary stream output on line 52a has the next 
highest priority and is selected for output by the multiplexor 48 if there 
are no isochronous data transfer words to be sent and after a data stream 
separation word for the primary stream has be sent; 

3) The encoded second stream output from the data buffer 42 on 
line 54b has the next iiighest priority and is selected for output by the 
multiplexor 48 if there are no isochronous data transfer words or encoded 
primary stream data words to be sent and after a data stream separation 
word for the second stream has be sent; . . . 

4) The encoded nth stream output from the data buffer 42 on line 
54n has the next highest priority and is selected for output by the 
multiplexor 48 if there are no isochronous data transfer words, encoded 
primary stream data words ... or n-1 stream data words to be sent and 
after a data stream separation word for the nth data stream has be sent; 
and 
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5) If .here are no d..a words or isochronous data tansfer words ,o 
be sen., .he scheduler 46 sends controls the multiplexor 48 such an 
IDLE word is transmitted. 

TT-e multiplexor 48 preferably has a pluraliQ, of inputs and a pluraHtv o, 
0 output. T.e multiplexor 48 preferably ,snao.to., multiplexors. T^e multiplexor 48 
™ a ptarality o, signals from the control code generator 44, the encoder 40 and 
thedatabuffer^Z Each of the signals is preferably ,0 pa^aUe, hits. TT,e multiplexor 48 

P^ovtdesone Of thesetsoflOparaUelM.satitsou.pu. Which iscoupled by 1^56. 
the mput of the parallel-to^erial converter ao. Por each word received by the parallel- 
10 to-sena, converter 50, it outputs the 10-bit words serially bit by bi, over line .8 

«='-^8™""°Rg>Te3,aspecificembodimen.offteembeddi„guni.22is 
shown in more detail. For ease o, unde^fanding and conventence, ,i.e par. have 

bee„labeledwiti„i,ereference„umerals. The specific embodiment shown in Figure 
3. . .ntended for use where .he pr,mary data stream includes video data, video control 
signals, and .sochronous data s.ream; and the oU,er data streams 1 to n are for 
additional multiplexed data that does not include isochronous infonnation The 
embodiment o, the present invention shown in Figure 3 is simiUr to U,e embodiment 
shown m figure 2, excep. *a. Ae encoder 40, data buffer 42 and control code 
generator 44 are replaced by a plurality of encoders 40a, 40b. 40c .. . 40„, 40u, 40v, a 

n : • = >"-"'V oi contiol code genera.ors 

44a, 44b, 44c . . . 44n, 44x, 44y, 44z, respectively. 

Still more particularly, a video dati. coder 40a is provided for encoding the 

video data signals to a 10-bi. parallel ou»u. Those skills i„ ,t . „ 

. f"'- '""^^skUledm the art will realize the 

video data coder 40a may be a pluralitv of 8.to l n Ki* ,. j j 
25 „fhi«,. '"'^""^'"-''"""^oders depending on the number 

ZTs t „ 177" '^^ *^ ■^'^ ^ 

th^ 8-to-lO btt coders U 24 bits of RGB data are used with 8 bits for a red channel, 8 
b^for a green channel, 8 bi. for a blue channel, or two 8-.O-10 bi. coders for 16 bits of 
YUV data. An exemplary video coder 40a constructed according .o *e present 
.nvention is shown in Figure 5. Coders 40u, and 40v are also provided for the video 
control data, and the isochronous data stream Similarly, for stream 1 to n each stieam 

Z ; r " ^"^^ — 

The coders 40b to 40n, 40u, 40v are preferably identical .r.M u 

P craoiy laentical, and each maps the eight bit 
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values applied on the inputs of the coders 40b to 40n to a corresponding 10-bit word 
according to a predefined coding scheme. An exemplary encoding scheme that can be 
used for coders 40b to 40n is detailed on pages 18-25 and Figure 7 of U.S. Patent 

Application Serial No. , entided "High-Speed Digital Video Signal Transmission 

5 System/' filed on March 27, 1996, which is incorporated herein by reference. 

The output of video data coder 40a, video control coder 40u, isochronous coder 
40v, are coupled by lines 52a, 52u, 52v, resp>ectively to corresponding inputs of the 
multiplexor 48. Each of the coders 40a, 40u, 40v, also provides an output coupled via 
line 64 to the scheduler 46 to provide a v^^aiting signal specifying whether there is data 
10 available at the output of the corresponding coder 40a, 40u, 40v, that can be sent on the 
serial link 28. 

The output of coder 1 40b is coupled by line 52b to the input of stream 1 buffer 
42b. The output of stream 1 buffer 42b is in turn coupled by line 54b to the an input of 
the multiplexor 48. The remaining coders 40c to 40n are similarly coupled through 

15 respective buffers 42c to 42n to respective inputs the multiplexor 48. Each stream 
buffer 42b, 42c, 42n is preferably a FIFO buffer capable of storing n encoded words, 
where n is the number of data streams multiplexed. The stream buffers 42b, 42c, 42n 
are preferably coupled to the scheduler 46 by line 62 to receive a control signal 
specifying when the stream buffers 42b, 42c, 42n should be clocked. Each of the stream 

20 buffers 42b, 42c, 42n also provides an output coupled via line 64 to the scheduler 46 to 
provide a waiting signal specifying whether there is data available at the output of the 
corresponding stream buffer 42b, 42c, 42n that can be sent on the serial link 28. 

The embodiment shovm in Figure 3 includes a plurality of control code 
generators 44a, 44b, 44c . . . 44n, 44x, 44y, 44z. The first control code generator 44x is 

25 coupled to an input of the multiplexor 48 via line 60a to provide the IDLE word. 

Additional control code generators 44y and 442 are provided for supplying the shut 
down link code and start up link code to the multiplexor via lines 60y, 60z, 
respectively. The remaining control code generators 44a, 44b, 44c . . . 44n provides 
respective data stream separation words, one for each stream. Each of the control code 

30 generators 44a, 44b, 44c . . . 44n, 44x, 44y, 44z is preferably hard wired to provide the 
10-bit words that are used for the IDLE word, start-up link word, shut-down link 
word, video start word, stream 1 start word, etc. in accordance with the encoding 
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schen.. The ^ochronous «.nsfer words ar. generated directly bv the v,deo coder 40a 
Those sMIed in the art wi, reaii^e that in an alternate e^bod^ent, a data input o, the 
mul.p,exor 46 could be coupled to a data output of the .heduler 46, and that ,n such 
an akerr^te embodiment the scheduler 46 would generated and provide these codes 

> words as necessary. 

TTte operation o, the present invenhon can best be understood with reference to 

T, .T """" ^ ''^^^ ^'-^ ^'Snal, the video 

control and data signals that form the primaty stream, data signals that for a second 
s^^, a,.d the serial stream produced by the embedding unit 22 and output on Une 
-8. One of the main purposes of the present invention is to make the embedding 
mechanism look transparent to the video signaU and isochronous data streams Tl,e 

tT' t ''"^ " - ^-Se due 

to *e embedded stgnals. T.e timing diagrams of Figures 4A and 4B cot^pond to U>e 
embodunent of the embedding unit shown in Hg„,, 3, where d,e video stream has the 
hrghest prronty, and thus, is sent without being disturbed by other st^ The 
present invention advantageously encodes the horizontal and verdca, sync signal into 
a pa,r of beginning and ending isochronous transfer words thereby making much of 
.he vert^cal and horizontal sync periods available mulHplexing witi, other stream data 
AS shown in figure 4A, video control signals are sen. by only sending otUy isochronous 
»^fer words at the rising and falling edges of the sync signal so the period when the 
vtdeo control signal doesn't change its value can be used to send other data. Rising and 
fallmg edges of each video control signals have different special chamcte,,. Data 
stream 1 is mserted during the horizontal blanking period and a start control word 
.dent^ing the data stream 1 U used a. the head of the data stream 1. Each multimedia 
data stream has its own special start contml wonl for identification. For example 
stream 1 has a different data stari word than that used for video start word. If every 
stream buffer is emptied and no video signal enters, the scheduler sends an IDtB word 
for b.t synchronization and word syr^hronizatron. Figure 4B shows a «ming diagram 
of an .sochronous data transmission using this invendon If we need to send 
.sochronous or time critical data dunng the transmission of other data, we can insert an 
^h^onous data trar^fer word in the middle of the data transmission. In particular, as 
shown ,„ F.gure 4B. the transm.ssion of the data for stream , in interrupted and a 
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isochronous data transfer word is sent, after which the data for stream 1 continues to 
be sent until there is no more stream 1 data to be sent. Thus, the present invention 
enables time critical data such as video control signals to be sent such that correct 
timing will be preserved when the signal is received. The removing unit 24 is able to 
5 receive normal data stream without a break in the presence of a special isochronous 
data transfer words and also separate isochronous timing information at a correct time. 

Referring now to Figure 6, a preferred embodiment for the scheduler 46 will be 
described. The scheduler 46 is resp>onsibIe for controlling the order in which encoded 
words are sent to the parallel-to-serial converter 50. The scheduler 46 preferably has a 

10 pluralit}' of control inputs coupled to receive a waiting signal from each of the coders 
40a, 40u, 40v, and the stream buffers 54b, 54c, 54n, and coupled to receive signals 
indicating whether the link is operational or not. The scheduler 46 also has a plurality 
of outputs for controlling the multiplexor 48 or each of the stream buffers 54b, 54c, 54n. 
The scheduler 46 may be implemented as combinational logic, a state machine, or a 

15 programmed processor such as in an application specific integrated circuit, but is best 
understood from one embodiment of its operation as shown by the flowchart of Figure 
6. As shown in Figure 6, the scheduler 46 first tests whether the power dovm signal is 
asserted in step 600. If the power dovm signal is asserted, the serial link 28 is to be shut 
down and the scheduler 46 send control signal to the multiplexor 48 to output the 

20 power dovm code. Then the scheduler 46 proceeds to step 604. If the power down 
signal is not asserted, the scheduler 46 proceeds directiy to step 604. In step 604, the 
scheduler 46 determines whether there is video data waiting to be send on the link 28. 
This can be done by monitoring the waiting output of coder 40a. If there is video data 
waiting to be sent, the scheduler 46 continues in step 606 by outputting a control signal 

25 to the multiplexor 48 to send the start video data code, and then in step 608 bv 

outputting a control signal to the multiplexor 48 to send the video data. After step 608, 
the scheduler 46 returns to step 600. If there is not video data waiting to be sent, the 
scheduler 46 proceeds to step 610 where i is set to 1 and the scheduler 46 outputs a 
control signal to send the IDLE code for a predetermined number, k, of clock cycles. 

30 Then in step 612, the scheduler 46 determines whether there are anv isochronous signal 
to be send such from the video control coder 40u or the isochronous word coder 40 v 
and outputs a control signal to send the isochronous control words. 
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Nex, in seep 614, the scheduler 46 detennines whefter .he .,1, stream has anv 
data ready K, be sen, over tt,e link 28. If no., the scheduler 46 continues in step 6^4 If 
the „H strean, has data ready to be sent over the link 28, then the scheduler 46 outputs 
control Signals .o the multiplexor 48 to send the start Hh star, word in step 6,6 Then ,n 
step 6,8, the scheduler 46 determines whether .here are any isochronous signal ,o be 
send such from the video control coder 40u or the isochronous word coder 40v and 
outputs a control signal to send the isochronous control words. TOs ensures that if 
there are any isochronous signals to be sen, over the hnk 28 .hey will be tnjected into 
he data stream immedU^ly to preserve fteir timing. I„en in step 620. the scheduler 
outputs the control signals to the multiplexor 48 to send a data word of .he „/, data 
stream. Nex. in step 622, the scheduler 46 tests whether U,ere are more charac.ers 

datastreamthatarestoredinAecorrespondingbufferthatneedtosent. ffso the 
method loops back to step 6,8. 1, no. the scheduler 46 continues in step 624, bv tesHng 
Whether «us is the last data stream by comparing ,he value of , to *e value of n, the 
number of data streams. ,f < is no. equal to n. the scheduler 46 increments .he vaiue of , 
.n s.ep 626 and thereafter condnues in step 6,4. If i is equal K> n. *e scheduler 46 
ouq,u« control signals .o output *e IDLE code in step 628, and then determines 
whether there are any isochronous signal to be send such from the video control coder 
40u or the .scchronous word coder 40v and outpuB a conM signal .o send the 

^hronous con.rol words in step 630. After step 630. the scheduler 46 reUrms to step 

6(X). ^ 

Turning now .o Figure 7. a first embodiment of the removing unit 24 is shown 
™e removing uni. 24 preferably comprises a driver 70, a seriaI-.o-parallel converter 7. 
^«'<-<'-"8ner73.as.reamselec,or76.ade.mu,tip.exor74,ada.abuffer78anda 
25 decoderSO. ^"emoving unit 24 separates the serial data from the link 28 in.o a 
plurahty of da.a s.reams. At the removing unit 24 side, Ute serial bi, stream is 
converted .o k-bi. parallel date words and word aligned. T*e k-bit parallel words are 
U.en routed ,o U,e app,.priate channel for decoding and ,hen use in a conventional 
mam,er. ™"y«em 20 of *e presem invenHon appears trar^parent such that the 
s.gna,s provided by the decoder 80 on lines 30a to 30„ are identical in date content and 
respechve hming as the corresponding signals input on lines 26a te 26n. Figure 7 also 
.Ilus.ra.es the use of the clock signal received on l.ne 32. The clock signal is pre.en.blv 
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provided to each of the components 72, 74, 76, 78 80 in a conventional manner for use 
in processing the serial bit stream received on line 28. 

The input of the removing unit 24 is provided by the input to a buffer or line 
driver 70. The output of the buffer 70 provides the serial data stream to the serial-to- 
5 parallel converter 72 via Hne 82. 

The serial-to-parallel converter 72 has a data input and a plurality of data 
outputs. The serial-to-parallel converter 72 converts the serial stream into a k-bit 
parallel data word. For example, the serial-to-parallel converter 72 converts the serial 
stream into a 10-bit word. The serial-to-parallel converter 72 also performs word 
10 alignment. For converting the serial stream to 10-bit words, an exemplary 

embodiment of such a serial-to-parallel converter 72 is shown in Figure 5 and the 
corresponding description of U.S. Patent Application Serial No. , entitled "High- 
Speed Digital Video Signal Transmission System," filed on March 27, 1996, which is 
incorporated herein by reference. The serial-to-parallel converter 72 may alternatively 
15 be constructed of a serial-in, parallel out shift register and a buffer register. The data 
input of the serial-to-parallel converter 72 is coupled line 82 to receive the serial data 
stream, and provides its parallel outputs on via line 83. 

. The output of the serial-to-parallel converter 72 is provided as an input to a 
word aligner 73. The word aligner 73 uses the idle characters in the data stream for bit 
20 and word synchronization. The word aligner 73 has a plurality of inputs and a 
plurality of outputs for receiving the encoded data in parallel and outputting the 
encoded data word aligned in parallel. The word size in the exemplary embodiment is 
preferably 10 bits. The plurality of inputs are coupled to line 83 and the plurality of 
outputs are coupled to line 84. The coupling of the word aligner 73 immediately after 
25 the serial-to-parallel converter 72 is particularly advantageous because special 

character separation can be done simply by counting the number of transitions within 
the 10-bit boundary. An example of a word aligner will be described in more detail 
below with reference to Figures lOA and lOB. 

The parallel, word-aligned bits on line 84 are provided as inputs to the de- 
30 multiplexor 74 and the stream selector 76. The de-multiplexor 74 preferably has a 

pluralitv of data inputs, a plurality of data outputs, and a control input. The inputs of 
the de-multiplexor 74 are coupled to receive an encoded word from the serial-to- 
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P«a,le, c„ The p,u..«ty „, „,^„, ^^^^ 

n^b.. o, o..pu« e,ua, eo .he „u„^ ,„ „^ Ue-.uWp.e..,. 74. Th„s eac 

se.o,o„^u..e«nes.ch.n„eUo.Mch.hew„...ece.ve.a..heinp..o,U,er 
mu, pU.o..4ca„^.outed. Hacho, .hese.o.ou^.„aheae-.u,Hp,e.o.7 . 
5 coupled ,o a .especHve .igna. line 88a, 88b, 88c, . . . 88n. In *e exen.p,ary 

en,bodu.en,, .here are 10 inpu., and n .e. „, ,0 „„,p„.. de-n,uWp,ex. 74 is 

po„ed o..hecha„ne,.o„MchU,e w„rdo„.he.„pu.o,a,ede-„;Hp,e.o, L„ 
be routed .s se.ec.ed, b, a signa, received Via line 86 .he ..ea» seJor 7T 

. fron, .h '° *° *^ ™ word 

fron, .he se„a,..o.pa,a«e, converrer 72. The s.rea„, seiecror 76 de.c. speciai words 

wis d'h 

word and *encoup,es,i„e84 wi.h *e appr„pr^.e s.rea. channel represen.ed by 
s.^n„es88a,88b,88c....88„,Si„ceeach3.rean,Hasa.ni,uesepara.onw:r 
upon de,e«.on o. U.e separaHon words. T^e s.rean. selecor 76 preferably does *is by 

^ec^,anou.p„,s.ean,cha„ne,wheneveras.r,con.o,wordo.asJan,ora 
-chronous dau characer o, .he video s.ea„, is provided on Une 84. „ nor^a, da.a 

w„rdsor.he,DLBwordarede.ec.edby.hes.rea.s^ec.or76,«,ereisnosre^lr 
cban,esand.hese,ec.eds.ean,.orou.p„«ng.hewordsre„.ins.nchanged.o: 

r„ern 7"^^'°''^'- ^"'"™^^-*"^^='»'---'P--p,ed. 

the hnk 28 .s opera.„„ for low power operation and o.her purpo^ 

The de^uitipiexor 74 o„.p„« .he various da« s.rea™ on signal lines 88a, 88b, 

2s ' . ■"""^^'"^'^^""=«^'--F'=«"'«inP«ofdecoder80. 
~, da.a s.ea„. are coupled .0 respec«ve inpu. o, a da« buffer 78 The 

' '^"""""^ *^ -h a 
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to decoder 80 as a group. In an alternate embodiment, the buffer 70 may be eliminated 
with the outputs of the de-multiplexor 74 coupled to respective inputs of the decoder 
80. 

Finally, the encoded parallel streams are applied to the inputs of the decoder 80 

5 via lines 88a, 90b, 90c . . . 90n. Each of the signal lines represents k-bits in parallel of an 
encoded v^rord. The decoder 80 effectively decodes or translates each signal line into a 
respective n-bit word. For example, the decoder removes any encoding provided by 
the embedding unit 24 by converting the 10-bit words into their original 8-bit word 
form. The signals are each output on a respective signal line 30a, 30b, 30c . . . 30n. 

10 Referring now to Figure 8, a second, more specific embodiment of the removing 

unit 24 is shown in detail. For ease of understanding and convenience, like parts have 
been labeled with like reference numerals. The specific embodiment shown in Figure 
8, is intended for use where the primary data stream includes video data and control 
sigi\als, and the other data streams 1 to n are for additional multiplexed data that does 

15 not include isochronous information. The embodiment of the present invention shown 
in Figure 8 is similar to the embodiment shown in Figure 7, except that the data buffer 
78 and decoder 80 are replaced by a plurality of stream buffers 78b, 78c . . . 78n and a 
plurality of decoders 80a, 80b, 80c . . . 80n, respectively. 

The second through nth outputs of the de-multiplexor 74 are coupled via lines 

20 88b, 88c, 88n to respective stream buffers 78b, 78c, 78n. The output of stream 1 buffer 
78b is in turn coupled by line 90b to the input of the first decoder 80b. The remaining 
streams are similarly coupled through respective buffers 78c to 78n to inputs of 
respective decoders 80c to 80n. Each stream buffer 78b, 78c, 78n is preferably a FIFO 
buffer capable of storing n encoded 10-bit words, where n is the number of strecims 

25 that are being de-multiplexed. 

Still more particularly, the video decoder 80a is provided for decoding the video 
data and control signals to a 8-bit parallel data output signal and parallel control 
signals. Similarly, for stream 1 to n each stream has a dedicated decoder 80b to 80n, 
respectively, to decode each particular data stream. The decoders 80a to 80n are 

30 preferably identical, and each maps the 10-bit values applied on the inputs of the 
decoders 80a to 80n to a corresponding 8-bit word by applying the inverse of the 
predefined coding scheme. An exemplary decoding scheme that can be used for the 
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decoders 80a to 80n is detailed on dsctpq 91; -)o j r- 

ueiaiiea on pages 25-28 and Figures 8 and 9 of U.S. Patent 

Application Serial No e„«t,ed "High-Speed Digital Video Signal Trar.nUssi„„ 

System,- filed on March 27, 1996, which is incorporated herem by reference 

'.an embodiment for the strean, selector 76 ,s shown ,n 
> deu„. ™^™bodimen,ofthes.reamselector76isdesignedforasvs.eminwhich,he 
pnmary stream is video control and data, and me remaining streams are data without 
any .sochronous data transfer words. TT,e stream selector 76 of Figure 9 pn=ferably 
■ncludes a plurality of comparators 102a . . . 102n, 102z. an OR-gate 112 and a binary 
encoder ,04. The st^am selector 76 may also include a plurality of registers or hard- 
wired couplings lOla . . . lOIa lOU. such that each outputs a different isochronous 
data transfer word or a data stream separatton word. Comparator A 102z has a firs, 
mput. a second input and an output and compares the signals applied at its input for a 
match The first input of comparator A 102z is coupled via line 106z to the output of 
the register lOOz storing the video control word(s). Thesecond input of Comparator A 
102Z .s coupled to receive the encoded word via line 84. The remaining comparators 1 
.o n 102a, . . . 102„ are similarly coupled to receive a respective start control word in 
.he first mput and the word from the serial link 28 on line 84. Th. output s.gnaling a 
match by comparator A 102^ is provided on line 110a to a firs, input of *e OR-gate 
112 The output Signaling a n^tch by comparator 1 102a is provided on line llOb to a 
second input of the OR.ga.e 112. The output of the OR-gate ,12 is in turn coupled to a 
f^s. mput of the binary encoder 104. Thus, if either a video conm,! word or a video 
su« word is received on line 84, then Ute binary encoder 104 will provide a signal to 
the de-muWplexor 74 via line 86 to output fte stream on line 88a. The outputs of the 
other comparators 102b. . . . 102n are similarly coupled to tespechve inputs of *e 
tanar,. encoder ,04 for transladon into a signal applied on line 86 that will switch the 
de-mulHplexor 74 output to .he appropriate stream signal line 88b. . . 88n 

Referring now to Figures lOA and ,0B, a preferred embodiment for the wort 
ahgner 73 wUl be described. The word aligner 73 will now be described with reference 
to a word aligner 73 for the exemplary embodiment in which the words are ,0 bits in 
sne. Those skilled in the are will recognize how to construe, word aligners where *e 
words have o,her sizes. The encoding scheme used by *e present mvenhon 
advantageously separates special characters from normal characters based on the 
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number of transitions within a word boundary. Idle characters have eight transitions 
within a 10 bit boundary while isochronous data transfer words and data stream 
separation words have six transitions within a 10 bit boundary; the isochronous data 
transfer words beginning v^th a 0, and the data stream separation words beginning 
5 with a 1. The IDLE words are noted below in Appendix A. An idle pattern is a 
continuous sequence of one of the idle words and its inverse. An exemplary idle 
pattern is: 011O1O1O1030030IO201011O1O1010IO0101030IO1101O101O1O0IOI03OI The 
word aligner 73 detects the idle pattern by looking at a 21 bit data window and 
counting the number of transitions within the 21 bit data window. If there are 18 

10 transitions for two successive periods within the 21 bit data window, the IDLE pattern 
is detected and word aligiunent is performed. It is guaranteed that there cannot be 18 
transitions for two successive periods within 21 bit data window for any combination 
of other special characters or normal data. 

As shown in Figure lOA, the word aligner 73 preferably comprises a first 

15 register 170, a second register 172, a third register 174, an idle character detector 176 
and a shifter 178. The first register 170 preferably has 10 inputs and 10 outputs. The 
inputs of the first register 174 are coupled to line 83 to receive the converted parallel 
word. The outputs of the first register 174 are coupled to the inputs D[9:0] of the 
shifter 178, inputs of the IDLE character detector 176 and the input of the second 

20 register 172. The second register 172, like the first register 174, preferably has 10 inputs 
and 10 outputs. The outputs of the second register 172 are coupled to the inputs 
D119:10] of the shifter 178, and inputs of the IDLE character detector 176. The least 
significant bit output, D[10j, of the second register 172, is also coupled to an input of 
the third register 170, The third register 170 preferably has an input and output, with 

25 the output coupled to the MSB input D[20] of the shifter 178, and an input of the IDLE 
character detector 176. The first, second and third registers 174, 172, 170 each have a 
clock input coupled to receive the system clock. Thus, over three successive clock 
cycles the 21 bit window output by the first, second and third registers 174, 172, 170 is 
provided to both the idle character detector 176 and the shifter 178. The shifter 178 

30 receives the 21 bits from the registers 174, 172, 170 and outputs 10 adjacent bits in 
response to the control signal applied to its inputs. The output of the shifter 178 is 
coupled to provide the 10 word-aligned bits on line 84. 
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The idle character detector 176 has inputs and outputs, and the outputs are 
coupled to the control inputs of the shifter 178. As shown in more detail in Figure lOB 
the .die character detector 176 preferably comprises a pluraUty of exclusive-OR gates ' 
180, a counter 182, a first AND gate 184, a D-flip.fl„p ,86, a second AND gate 188 a 
shtft-controi pointer 190 and a MSB detector 190. There are preferablv twenty 
exclusive-OR gates 180. Each of the exdusiva-OR gates 180 has its two inputs coupled 
h> receive adjacent bits. For example, a firs, exclusive-OR gate ,80 is coupled to receive 
b.ts DO and D,, and the next exdusiveOR gate 180 is coupled to receive bits Dl and 
DX and so on. Each of the outputs of the plurality of exdusiveOR gates 180 are 
coupled to a respecdve input of the counter 182. Tlte counter ,82 preferably counts the 
number of ones receive on its inputs, thereby, counting the number of transitions in the 
21 b,t window, -me counter 182 also encodes the number of ones into a 5 bit binary 
number. TKus, the counter ,82 has five outputs. n,e second and fifth outputs of the 
counter 182 (CNT4, represenHng the MSB - 16 and CNT 1 representtng the next to LSB 
- 2) are coupled to respective inputs of AND gate 184. Tl,us, AND gate 184 signals a 
condition when there are eighteen transitions on the 2, bit window. T,,e output of 
AND-gate 184 is input to AND-gate ,88 directly and through the flip-flop ,86 The 
output of AND-gate ,88 is used to control the loading ,he sHft-control pointer register 
190. and the shift-control pointer register 190 will be loaded only if there a,^ eighteen 
transitions on the 21 bit window in .wo successive cycles. The input of the shift^ontrol 
pomter repster 190 is coupled to the output of the MSB detector 192 The MSB 
detector 192 is coupled to receive bits 0(20:10) from the second and third registers 172 
170, and outputs a value indicating the position of the MSBof the idle word For 
example, for the above exemplary idle pattern, the MSB detector 192 will find the 
posmon of either the sequence 0,1 or 100 as the MSB position, and will output a value 
of the MSB for the word correctly aligned, which in turn will be loaded into the shift- 
control pointer register 190 to control the shifter 178 via line 194. 

Tuirtng now to Figure H, a third embodiment of the removing unit 24 is 
shown. For ease of understanding and convenience. Figure 11 only shows the portions 
of the third embodiment that differ from the other embodiments. In particular, the 

decoders have not been incIudeH in Pirr,,,,, 11 ^ c 

en mciuaed m Figure 11, to focus on the differences between this 

embodiment and previous embodiments ApainFr^rHv^ . u 

uixnents. Agam, For like parts, which have similar or 
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identical functionality, have been labeled with like reference numerals used in the 
other embodiments. The third embodiment of the removing unit 24 is particularly 
advantageous because it includes a "bubble buffer" structure 120 to separate normal 
data v^ithout a break from special isochronous data transfer words. The third 
5 embodiment of the removing unit 24 further comprises a data selection controller 122, 
a plurality of buffers 124a, 124b, . . . 124n, a multiplexor 126 and an isochronous word 
decoder 128 that form the bubble buffer structure 120, in addition to the driver 70, the 
serial-to-parallel converter 72, the word aligner 73, the de-multiplexor 74 and the 
decoder 80 that have already been described above with respect to other embodiments. 

10 The data selection controller 122, a plurality of buffers 124a, 124b, . . . 124n, a 

multiplexor 126 and an isochronous word decoder 128 are preferably coupled between 
the serial-to-parallel converter 72 and the de-multiplexor 74. 

The "bubble buffer" structure 120 of the third embodiment of the removing unit 
24 provides a plurality of buffers 124a to 124n. The number of buffers 124a to 124n is 

15 preferably at least as many the number of different data streams that are capable of 
being multiplexed into the serial stream by the embedding unit 22. The first buffer 
124a has an input and an output. The input of the first buffer 124a is coupled to line 
130a to receive the output of the word aligner 73. The output of the first buffer 124a is 
coupled by line 130b to the input of the second buffer 124b. The remaining buffers 

20 124b to 124n are similarly coupled in a cascaded manner to form an n-stage buffer. The 
final buffer 124n has its output coupled to an input of the multiplexor 126, and to the 
input of the isochronous word decoder via line 130n. The output of each buffer 124a, 
124, 124n is preferably coupled to a respective input of the multiplexor 126 via a 
respective output line 130b, 130c, 130n. Thus, the multiplexor 126 is able to provide 

25 any of the n words stored in the bubble buffer 120 to the input of de-multiplexor 74 
using line 84, and then on to the appropriate channel through the de-multiplexor 74. 
The outputs of the serial-to-parallel converter 72 and the first n-1 buffers are also 
coupled to respective inputs of the data selection controller 122 by lines 130a, 130b and 
130c, respectively. 

30 As has been noted above, the final buffer 124n has its output coupled to the 

input of the isochronous word decoder 128 via Une 130n. This allows any isochronous 
words to be decoded while preserving timing within the signal. The isochronous word 
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decoder 128 preferably decodes the isochronous words and outputs the corresponding 
tuning control signals on line 135. For example, the isochronous word decoder 128 
may be a decoder like the others described above as well as additional generation logic 
as w:II be understood to those skilled in the art to provide the control signals :n the 
0 format and on lines as desired. For example, if the only isochronous signals were the 
horizontal sync signal, the vertical sync signal and the DE control signal used with 
video, the additional generation logic would provide a separate signal line for each 
control signal and asserted and de-assert the signals in response to the receipt of 
isochronous data transfer words indicating when to assert such control signals 
10 The data selection controller 122 controls the operation of the bubble buffer 120 

and receives data signals from the serial-to-parallel converter 72 and the buffers 124a 
124b on lines 130a, 130b, 130c. The data selection controller 122 also has an input 
coupled to the output of the multiplexor 126 via line 134. The data selection controller 
122 specifies which the buffer outputs will be input to the de-multiplexor 74. Tl.e data 
15 selection controller 122 has an output coupled by line 132 to the control the multiplexor 
126. The data selection controller 122 basically maintains a pointer to the buffer 124a 
124b. 124n whose output is being output by the multiplexor 126. The data selection 
controller 122 monitors the (n - l)th buffer 124b for an isochronous data transfer word 
If no isochronous data transfer word is detected, the data is transferred tiuough buffer 
20 n and on to the de-multiplexor 74. If an isochronous data transfer word is detected 
then after the next clock: 1) the isochronous data transfer word will be stored in the 
nth buffer and provided to the isochronous word detector 128, and 2) the multiplexor 
126 will be switched to provide the output of the next buffer to the left that does not 
store an isochronous data transfer word at the output of the multiplexor 126 
25 Referring now to Figure 12, the data selection controller 122 is shown in more 

detail. The data selection controller 122 preferably comprises an isochronous word 
detector 140, a selection pointer 142, an idle word detector 144 and a multiplexor 150 
The selection pointer 142 has an up control input, a down control input, and an output 
The selection pointer 142 determines which signal will be output bv multiplexor 126 
30 because its output is coupled via line 132 to the control inputs of multiplexor 126 The 
output of the selection pointer 142 is also coupled to the control input of multiplexor 
150 to control the signal applied to the isochronous word detector 140. The selection 
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pointer 142 can be any kind of pointer which provides control signals for an N-to-1 
multiplexor and a up/ down control for the pointer. In Figure 12, the pointer is a N-bit 
uruiry pointer. Only one bit out of N bits can have logic value 1. If an up signal is 
applied, the position of logic 1 bit moves to right. If a dov^ signal is applied, it moves 
5 to left. 

The idle word detector 144 has an input and an output, and compares the signal 
applied at its input to the value used in the encoding scheme for an IDLE word. The 
input of the idle word detector 144 is preferably coupled via line 134 to the output of 
the multiplexor 126. The output of the idle word detector 144 is coupled via line 148 to 

10 the up control input of the selection pointer 142. Thus, whenever an idle character is 
detected at the output by the multiplexor 126, the selection pointer 142 will be moved 
left or upward toward N. The selection pointer 142 will continue to point to N for 
additional assertions of the up control input if the pointer is already pointing to N. An 
exemplary idle word detector 144 is shown with specificity in Figure 13. The 

15 exemplary embodiment of the idle word detector 144 preferably comprises a plurality 
of exciusive-OR gates 200, a plurality of adders 202, and a plurality of half adders 204. 
The exclusive-OR gates 200, a plurality of adders 202, and a plurality of half adders 204 
are coupled as shown in Figure 13, and are used to count the number of transitions in 
the word input to the idle word detector 144. Since the encoding scheme requires that 

20 an idle character have eight transitions, the output of the final half adder 204 is 

asserted and output via line 148 if eight transitions are detected by the plurality of 
exclusive-OR gates 200. 

The isochronous word detector 140 is used along with multiplexor 150 to control 
the movement of the selection pointer 142 dovmward. The isochronous word detector 

25 140 has an input and an output, and compares the signal applied at its input to the 
value(s) used in the encoding scheme for isochronous data transfer words. Thus, the 
isochronous word detector 140 may be comprised of a plurality of comparators, each 
comparing the input signal to a respective isochronous data transfer word of the 
encoding scheme, with their outputs logically ORed together in one exemplary 

30 embodiment. The input of the isochronous word detector 140 is preferablv coupled to 
the output of the multiplexor 150. The output of the isochronous word detector 140 is 
coupled via line 146 to the down control input of the selection pointer 142. Thus. 
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whenever an isochronous data transfer wmrfi. - . , 

i4n„:. ,^ , ^'"''"""""P'" to the isochronous word detector 

140 v,a muihplexor 150, the selection pointer 142 will 

n. , f^"""" "2 wiU be moved right or downward 

toward 1 . The multiplexor 150 has its selert i • , 

. , ^ ™''''^'""trol input coupled to signal lines 132 

and selects either the output of the seri,l,„„ n, , 
5 staeesl24a u ^ """^"^ 72 or one of the buffer 

stages 24a. n4b as the input to the isochronous word detector 140. Yet another 

exemplary embodiment of the tsochronous word detector ,40 is shown in Figure 14 
l^e exemplary embodiment of the isochronous word detector 140 comprises^ 

ira r ""'''^"'""■''"""'^"'"'''-^'^^■''-"•y-ha.adders 
m an an AND gate. The plurality o, exclusive-OR gates 210. a plurahty of adders 

^Zaplur^.tyofha«adders214.andanA.Ogatearecoupledasshow!inHg:::, 

w„rddetectorl40,andtodetectaleadi„gO.Theencodingschemere<,„ires.ha.r 
^^onous transfer wordshaveaOintheMSB position and havesix^^^^ 

15 ZrirTr "'"'^^'''""'•''="''«^«^'-'""P''"Sofadders212a„d 

atl ed . .H ^'"^ — - *e word 

apphed to the .nput of the isochronous word det^tor ,40. T„e AND gate 2,6 adds the 
addihonal condition that the MSB of the w.rd be 0 in , u '^"'"<'**e 
eate31fi.„>„ . '"^ «'■> order for the output of the AND 

gate 216 to be asserted and signal the detecKon o( ■ u 

_ * ^"^"""O' an "sochronous transfer word The 

output of the AND gate 216 is coupled to line ,46 to si„,l ^ 
20 theselecHonpomterI42. '""""o ='S"=' a decrease m the position of 

™^°'--«°'-°'*ebubblebuffer,20canbebes,beunders.oodwi.hrefer™ce 

2 : r'"'"""'"^^^^'- ^'^--"'-atesthesituaHon 

^ T; "^'^^ ■^"'^ ^" '"'O ^ -am 

For^^^gurel5,.hereare4digita,buffers.andD0-DSarenormaldata stream. DOarrtves 
at the receiver a. first and 05 at last. But after DO an isochronous data transfer word „ 

^™-™ese,ectionpomter,42doesn.tchangeunti,timeslot4. The isochrol!' 

tirr"'" '^'^^'^ ''""^^-^ -"'-.r; 

and isochronous data appears at the same time; the normal data being output through 
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the multiplexor 126 to the de-muitiplexor 74, and the isochronous data being output by 
the nth buffer 124n to the isochronous word decoder 128. Thus, the normal data is 
received without a break and the isochronous data received without any timing 
change. At time slot 7, the idle word detector 144 receives an IDLE word from 
multiplexor 126 and moves the selection pointer 142 to right. After the pointer reaches 
its rightmost position, the pointer moves no more. A maximum N isochronous 
characters can be inserted and received at correct timing without making a "bubble" at 
normal data streams. It is notable that the selection pointer 142 can be moved N points 
during one cycle to insert N isochronous characters in a row. 

Turning now to Figure 16, yet another embodiment of the removing unit 24 of 
the present invention is shown. This fourth embodiment of the removing unit 24 is 
similar to the third embodiment, but further comprises a video line buffer 160. Again, 
like reference numbers have been used for like parts used in the above described 
embodiments. The fourth embodiment differs from the other embodiments in that the 
video line buffer 160 is coupled to the output of the video decoder 80a via line 90a. The 
presence and use of the video line buffer 160 allows the video refresh data to be 
divided into smaller groups or blocks at the embedding unit 22 without affecting the 
output of the video data on the removing unit 24 side. Typically, video refresh data is 
accessed from frame memory and sent to display continuously. The timing as to when 
the display data can be sent is fixed in a conventional display data transfer. However, 
with the addition of the line buffering of video signal, the refresh data stream can be 
divided into smaller chunks. This in turn makes data transfer much easier and frame 
access is made more flexible. Since the video data stream can be divided into smedler 
pieces, other multimedia data streams can be inserted with more flexibility'. The fourth 
embodiment is also different other embodiments because the isochronous stream of 
control words provided by the bubble buffer 120 on line 130n is sent as an output, and 
is also provided as an input to the video decoder 80a along with the video data 
received vial line 88a from the de-multiplexor 74. As video data is received and 
decoded by the video decoder 80a, it is loaded into the video line buffer 160. The 
smaller (less than entire line) chunks or blocks of data are sent to the line buffer 160 
until it is full. After a line buffer is filled, the line is sent to the digital display. This line 
buffering makes the dividing of the refresh video data mechanism completely 
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transparent to the display interface Fio,™!? u 

H y menace, higure 17 shows a timing diagram of an 

exemplary way in which the video refresh dafa r.r.u a- a ^ 

rexresn data can be divided into two blocks, and 

.rar^nutted over fte serial li,* 28, as weU as being mixed wi.h another n,aiHn,edia 
s^n,^ A. the removing uni. 24, a,e firs, video data block sent during the penod 
when the sync sign,, is assened and the second video data block s«,t after n..,hn,ed. 
data stream f can be recon,bi„ed in the line buffer ,60 to provide the v.deo data as , 
there had been no division during transfer. 

'^''h'P-^ent invention has been described With reference to certain 
preferred embodiments, those skilled in the ar, wUl recognize that vanous 

modficadons may be provided. For example, the present invention has been 
d^cus^ above primarily in .he context of a 8B/10B encoding/decoding scheme. 
Tliose sk,lled in the art will realize that the present invenhon may be applied 
independent o, the number of bit used for encoding. Furthermore, those skilled in the 
art wm realize that bi-directional communication systems may be constructed using 
mulhple embedding units ar.d removing units as shown by the examples in Figu J 
I8A and ,8B. These and other variahons upon and modifications to the preferred 
embodiments are provided for by the present invention, which is limited onlv by the 
following claims. ' 

Appendix A - Sample Control Words 

20 

IDLE Words 
0101010110 
0101011010 
0101101010 
25 0110101010 
1010101001 
1010100101 
1010010101 
1001010101 

30 

Isochronnnc Qata Tr»n^f„ w»>^^ 

ooioiomo 

0010110110 
0010111010 
35 0011010110 
0011011010 
0011101010 
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0100101110 
- 0100110110 

0100111010 

0101001110 
5 0101011100 

0101100110 

0101101100 

0101110010 

0101110100 
10 0110010110 

0110011010 

0110100110 

0110101100 

0110110010 
15 0110110100 

0111001010 

0111010010 

0111010100 

20 Data Stream Separarion Words 

1000101011 

1000101101 

1000110101 

1001001011 
25 1001001101 

1001010011 

1001011001 

1001100101 

1001101001 
30 1010001011 

1010001101 

1010010011 

1010011001 

1010100011 
35 1010110001 

1011000101 

1011001001 

1011010001 

1100010101 
40 1100100101 

1100101001 

1101000101 

1101001001 

1101010001 

45 

Link Shut Down Words 

0000000000 

1111111111 
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1. A system for sending multiple data signals over a serial link, the svstem 
comprising: 

an embedding unit having a plurality of inputs and an output, the embedding 
unit encoding a plurality of input data streams to produce encoded data 
streams and combining the encoded data streams into a data transfer 
stream, the plurality of inputs each coupled to receive a respective data 
Stream; 

a serial link coupled to the output of the embedding unit; and 
a removing unit having an input and a plurality of outputs, the input of the 
removing unit coupled to the serial link to receive the data transfer 
stream from the embedding unit, the removing umt separatmg the data 
transfer stream into a pluraHty of separated data streams and decoding 
the separated data streams to remove the encoding applied bv the 
embedding unit, the removing unit providing each of the decoded, 
separated data streams on a respective one of the plurality of outputs of 
the removing unit. 

2. The system of claim 1, wherein the embedding unit further comprises: 
an encoder having a plurality of inputs and a plurality of outputs, each of the 
plurality of inputs coupled to receive a respective data stream, the 
encoder receiving data words and producing encoded data words; 
a multiplexor having a control input, a plurality of data inputs and a plurality of 
data outputs, the multiplexor selecting one set of the plurality of inputs 
to be output as a data transfer stream, the inputs of the multiplexor 
coupled to the plurality of outputs of the encoder; 
a paraUel-to-serial converter having a plurality of inputs and an output, the 
plurality of inputs of the parallel-to-serial converter coupled to the 
outputs of the multiplexor; and 
a scheduler having a plurality of inputs and an output, the scheduler controlling 
the data stream output over the serial link, the inputs of the scheduler 
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coupled to the outputs of the encoder, and the output of the scheduler 
coupled to the control input of the multiplexor. 

3. The system of claim 2, wherein the embedding unit further comprises a 
data buffer having a plurality of inputs and a plurality of outputs, the data buffer 

5 coupled between the encoder and the multiplexor. 

4. The system of claim 2, wherein the embedding unit further comprises a 
control code generator for producing control codes identifying streams, when the link 
is idle and isochronous control characters, the control code generator having a 
plurality of outputs coupled to corresponding inputs of the multiplexor. 

10 5. The system of claim 2, wherein the encoder encodes each group of eight 

bits into a group of ten bits. 

6. The system of claim 2, wherein the serial lir\k is a data signal line and a 
clock line. 

7. The system of claim 2, wherein the serial link is a plurality of data signal 
15 lines and a clock line. 

8. The system of claim 2, wherein the serial link is three data signal lines 
and a clock line. 

9. The system of claim 1, wherein the removing unit further comprises: 
a converter having an input and a plurality of outputs for converting a serial 

stream into a data word output in parallel, the input of the converter 
coupled to the serial link; 
a de-multiplexor having a control input, a plurality of inputs and a plurality of 
outputs, the plurality of outputs grouped in sets such that each set 
provides a different stream of data, the plurality of inputs of the de- 
multiplexor coupled to the plurality of outputs of the converter; 



20 



25 
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a stream selector having a plurality of inputs and an output for generatmg a 

control signal indicating a set to which to send a data word, the plurahty 
of inputs of the stream selector coupled to the plurality of outputs of the 
converter, and the output of the stream selector coupled to the control 
input of the stream selector; and 
a decoder having a plurality of inputs and a plurality of outputs for decoding a 
data word, the inputs of the decoder coupled to respective outputs of the 
de-multiplexor. 

10. The system of claim 9, wherein the removing unit further comprises a 
data buffer having a plurality of inputs and a plurality of outputs, the data buffer 
coupled between the de-multiplexor and the decoder. 

11. The system of claim 9, wherein the decoder decodes each group of ten 
bits mto a group of eight bits. 

12. Hie system of claim 9, wherein the stream selector further comprises a 
plurahty of comparators, each comparator coupled to receive the data word from the 
converter and a respective stream start control word. 

13. The system of claim 9, wherein the removing unit further comprises a 
word ahgner having a plurality of inputs and a plurality of outputs, the word aligner 
coupled between the converter and the de-multiplexor, the word aligner using idle 
words in the data stream and shifting the data bit-wise for word ahgnment. 

14. The system of claim 9, wherein the removing unit further comprises an n- 
stage bubble buffer for storing data words output by the converter, the n-stage bubble 
buffer having a plurality of inputs and a plurality of outputs, the n-stage bubble buffer 
coupled between the converter and the de-multiplexor, the n-stage bubble buffer 
separating isochronous data characters from a data stream output to the de- 
multiplexor. 
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15. The system of claim 1, wherein the serial link includes a first data signal 
line, a second data signal line and a clock line, the first data signal line and the clock 
line coupled to the embedding unit and the removing unit, and wherein the svstem 
further comprises: 

5 an encoder having an input and an output, the input of the encoder coupled to 

receive a return data stream, the encoder producing encoded data words 
from the return data stream, the output of the encoder coupled to the 
second data signal line; and 
a decoder having an input and an output, the input of the decoder coupled to 
10 the second data signal line, the decoder producing a data stream from the 

encoded data words. 



16. The system of claim 1, wherein the serial link includes a first data signal 
line, a second data signal line and a clock line, the first data signal line and the clock 
line coupled to the embedding unit and the removing unit, and wherein the system 
1 5 further comprises: 

a second embedding unit having a plurality of inputs and an output, the second 
embedding unit encoding a plurality of input data streams to produce 
encoded data streams and combining the encoded data streams into a 
return data transfer stream, the plurality of inputs of the second 
20 embedding unit each coupled to receive a respective data strecim, and the 

output of the second embedding unit coupled to the second data signal 
line; and 

a second removing unit having an input and a plurality of outputs, the input of 
the second removing unit coupled to the second data signal line to 

25 receive the return data transfer stream from the second embedding unit, 

the second removing unit separating the return data transfer stream into 
a plurality of separated data streams and decoding the separated data 
streams to remove the encoding applied by the second embedding unit, 
the second removing unit providing each of the decoded, separated data 

30 streams on a respective one of the plurality of outputs of the second 

removing unit. 
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17. An apparatus for transmitting a plurality of data streanrs as a single data 
Stream, the apparatus comprising: 

an encoder having a plurality of inputs and a plurality of outputs, each of the 
plurality of inputs coupled to receive a respective data stream, the 
encoder producing encoded data words from the data streams; 

a multiplexor having a control input, a plurality of data inputs and an output, 
the multiplexor selecHng one of the plurality of inputs to be output as a 
data transfer stream, the inputs of the multiplexor coupled to the 
plurality of outputs of the encoder; and 
a scheduler having a plurality of inputs and an output, the scheduler controlling 
the data stream output over the serial link, the plurality of inputs of the 
scheduler coupled to the plurality of outputs of the encoder, and the 
output of the scheduler coupled to the control input of the multiple 



lexor. 



18. 



The apparatus of claim 17, further comprising a parallel-to-serial 
converter having an input and an output, the input of the parallel-to-serial converter 
coupled to the output of the multiplexor receive an n-bit word in parallel, the parallel- 
to-senal converter outputting the n-bit word as a serial stream. 

19. The apparatus of claim 17, further comprising a data buffer having a 
plurahty of mputs and a plurality of outputs, the data buffer coupled between the 

20 encoder and the multiplexor. 

20. The apparatus of claim 19. wherein the data buffer comprises a plurality 
of dedicated buffers, each of the dedicated buffers having an input and an output, each 
of the dedicated buffers having stonng an encoded data stream output by the encoder 
and each of the dedicated buffers coupled between a respective one of the plurality of ' 
outputs of the encoder and a respective one of the plurality of inputs of the 
multiplexor. 



21. The apparatus of claim 17, further comprising a control code generator 
for producing control codes identifying streams, idle conditions and isochronous 
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control characters, the control code generator having a pluraHty of outputs coupled to 
corresponding inputs of the multiplexor. 

22. The apparatus of claim 21, wherein the control code generator is a 
plurality of lines wired to word values assigned for stream start control words, 

5 isochronous data transfer words, and an idle control word. 

23. The apparatus of claim 17, wherein each of the inputs of the encoder 
receives eight bits in parallel and each output of the encoder provides 10 bits in 
parallel, and the encoder encodes each group of eight bits into a group of ten bits. 

24. The apparatus of claim 17, wherein the encoder further comprises a 

10 plurality of dedicated encoders, each of the dedicated encoders having an input and an 
output, the input of each dedicated encoder coupled to receive a respective data 
stream, and the output of each dedicated encoder coupled to a respective input of the 
multiplexor. 

25. The apparatus of claim 24, wherein the each of the dedicated encoder 
15 encodes one from the group of data signals and control signals. 

26. The apparatus of claim 24, wherein the at least one of the plurality of 
dedicated encoders encodes a combination of data signals and control signals. 

27. The apparatus of claim 24, wherein a first one of the plurality of 
dedicated encoders encodes video data, a second one of the plurality of dedicated 

20 encoders encodes video control data, and a third one of the plurality of dedicated 
encoders encodes a first stream of data. 

28. The apparatus of claim 24, further comprising a plurality of dedicated 
buffers, each of the dedicated buffers having an input and an output, the input of each 
dedicated buffer coupled to an output of a respective dedicated encoder, and the 

25 outputs of each dedicated buffer coupled to inputs of the multiplexor. 
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29. The apparatus of claim 15, wherein the scheduler is state machine formed 
from combinational logic that determines whether the encoder has data to be 
transmitted, and generates signals to control the multiplexor to output data and 
control codes such that isochronous codes have the highest priority and are 
transmitted before other data streams, and transmission of other data streams is 
preceded by a stream start control code. 

30. The apparatus of claim 15, wherein the scheduler further comprises: 
means for determining whether the encoder has data that is ready to be 

transmitted, the determining means coupled to the encoder; and 
means for identifying a stream that has data for transmission, the means for 

identifying coupled to the encoder; 
means for generating a first control signal for controlling the multiplexor to 

output a code identifying a beginning of a data stream transmission by 

the identified stream; and 
means for generating a second control signal for controlling the multiplexor to 

output the data from the encoder for the identified stream. 

31. An apparatus for receiving a data stream and generating a plurality of 
data streams, the apparatus comprising: 

a de-multiplexor having a control input, a data input and a pluralitv of outputs, 
the plurality of outputs each providing a different stream of data, the 
input of the de-multiplexor coupled to receive a data stream; 

a stream selector having an inputs and an output for generating a control signal 
indicating an output to which to send a data word, the input of the 
stream selector coupled to data input of the de-multiplexor, and the 
output of the stream selector coupled to the control input of the de- 
multiplexor; and 

a decoder having a plurahty of inputs and a plurality of outputs for decoding 
data words, the plurality of inputs of the decoder coupled to respective 
one of the plurality of outputs of the de-multiplexor. 



-36- 

suBsnruTE sheet (rule 25) 



wo 97/48056 



PCTaJS97/106n 



32. The apparatus of claim 31 further comprising a converter having an input 
and a plurality of outputs for converting a serial stream into a data word output in 
paraJIel, the input of the converter coupled to the serial link, the outputs of the 
converter coupled to the input of the de-multiplexor. 

33. The apparatus of claim 31 further comprising a data buffer having a 
plurality of inputs and a plurality of outputs, the data buffer coupled to the de- 
multiplexor and the decoder. 

34. The apparatus of claim 33, wherein the data buffer comprises a plurality 
of dedicated buffers, each of the dedicated buffers having an input and an output, each 
of the dedicated buffers having storing an encoded data stream output by the de- 
multiplexor, and each of the dedicated buffers coupled to a respective one of the 
plurality of outputs of the de-multiplexor and a respective one of the plurality of 
inputs of the decoder. 

35. The apparatus of claim 31, v^herein the decoder decodes each group of 
ten bits into a group of eight bits. 

36. The apparatus of claim 31, wherein the decoder further comprises a 
plurality of dedicated decoders, each of the dedicated decoders having an input and an 
output, the input of each dedicated decoder coupled to receive a respective data stream 
from the de-multiplexor. 

37. The apparatus of claim 36, wherein each of the dedicated decoders 
decodes encoded words into one from the group of data signals and control signals. 

38. The apparatus of claim 36, wherein the at least one of the plurality of 
dedicated decoders decodes an encoded word into a combination of data signals and 
control signals. 

39. The apparatus of claim 31, wherein the stream selector further comprises 
a plurality of comparators, each comparator having a first input, a second input and an 
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output, the fas. input of each comparator coupled to receive the data word from the 

converter and thesecond input of each comparatorcoupled to receivearespecttve 
stream start cont^l word, and the outputs of the plurality o, comparator coupled to 
control the de-multiplexor. 

40. Th^PParatus of claim 32 further comprising a word aligner having a 
plurauty of inputs and a plurality of outputs, the word aligner coupled between the 
conver^ and .he de-mul«plexor. the word aligner using idle words in the data stream 
and shtftmg the data bit-wise for word aUgnment. 

41. The apparatus of claim 40 wherein the word aligner further comprises- 

a register having an input and an output, the input of the register coupled to the 
output of the converter, the register for storing a plurality of data words; 

a shzfter having a data input, a control input and an output, the data input of the 
shifter coupled to the output of the register, the shifter outputting . 
predefined number of bits, the predefined number of bits less than 
number of bits received at the input of the shifter; and 
an idle character detector having an input and an output the input of the idle 
character detector coupled to the output of the register, and the output of 
the .die character detector coupled to the control input of the shifter, the 
idle character detector detecting an idle character and producing signals 
specifying the number of bits to shift a signal input to the shifter 



; a 
i a 



42. 



The apparatus of claim 41 wherein the register further comprises- 
a first register having an input and an output, the input of the first register 
coupled to the output of the converter, the output of the first register 
coupled to the idle character detector and the shifter; 
a second register having an input and an output, the input of the second register 
coupled to the output of the first register, the output of the second 
register coupled to the idle character detector and the shifter; and 
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a third register having an input and an output, the input of the third register 
coupled to the output of the second register, the output of the third 
register coupled to the idle character detector and the shifter. 

43. The apparatus of claim 41 wherein the idle character detector further 
5 comprises: 

an array of excIusive-OR gates having inputs and outputs, the inputs of the 
array of exclusive-OR gates coupled to the output of the register; 

a ones counter having inputs and outputs, the inputs of the ones counter 
coupled to the outputs of the array of exclusive-OR gates; and 
10 a control pointer register having a control input coupled by a register and 

combinational logic to the output of the ones counter to load the control 
pointer register v^^ith a value identifying the beginning of the word. 

44. The apparatus of claim 31 further comprising an n-stage bubble buffer for 
storing data words, the n-stage bubble buffer having an input and a first data output, 

15 and a second data output, the second data output of the n-stage bubble buffer coupled 
to the de-multiplexor, the input of the n-stage bubble buffer coupled to receive a data 
stream, the n-stage bubble buffer separating isochronous data characters from a data 
stream output to the de-multiplexor. 

45. The apparatus of claim 44 wherein the n-stage bubble buffer further 
20 comprises: 

a plurality of data buffers each having an input and an output, the plurality of 

data buffers coupled in a cascaded manner; 
a multiplexor having a plurality of data inputs, a control input and an output, 

the plurality of data inputs of the multiplexor each coupled to a 
25 respective output of one of the plurality of data buffers, the output of the 

multiplexor coupled to the input of the de-multiplexor; and 
a data selection controller having a plurality of inputs and an output, for 

generating a signal that selects one of the outputs of the pluralitv of data 

buffers for output by the multiplexor, the plurality of inputs of the data 
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selection controller each coupled to a respective output of one of the 
plurality of data buffers, the output of the data selection controller 
coupled to the control input of the multiplexor, and one of the pluralitv 
of inputs of the data selection controller coupled to the output of the ' 
multiplexor. 

46. The apparatus of claim 45 wherein the n-stage bubble buffer further 
comprises an isochronous word detector having an input and an output, the input of 



the isochronous word detector coupled to the output of one of the pluralit>' of data 

generating 



buffers, the isochronous word detector detecting an isochronous word and 



1 0 control signals at the output 

47. A method for transmitting a plurahty of data streams over a signal line 
comprising the steps of: 

receiving a first data stream and a second data stream; 
encoding the first and second data streams into coded words; 
transmitting a first control code over the signal line; 

transmitting the encoded words of the first data stream over the signal line; 
transmitting a second control code over the signal line; and 
transmitting the encoded words of the second data stream over the signal line. 

48. The method of claim 47 further comprising the step of transmitting a 
third control code over the signal line, the third control code indicating a 
discontinuation of conununication over the line. 

49. The method of claim 47 further comprising the step of transmitting a 
thud control code over the signal line, the third control code indicating a start of an 
isochronous data signal. 

25 50. The method of claim 48 further comprising the step of transmitting a 

fourth control code over the signal line, the fourth control code indicating a end of an 
isochronous data signal. 
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51. The method of claim 47 further comprising the step of sending a first 
special code word when the first control code, the encoded words of the first data 
stream, the second control code, and the encoded words of the second data stream are 
not being transmitted over the signal line. 

5 52. The method of claim 47 further comprising the steps of: 

generating an isochronous code word in response to an assertion of a time 

critical control signal; and 
trjinsmitting the isochronous code word over the signal line. 

53. The method of claim 52 wherein the step of transmitting the isochronous 
10 code word further comprising the steps of: 

determining whether one from the group of the first control code, the encoded 
words of the first data stream, the second control code, and the encoded 
words of the second data stream are being transmitted over the signal 
line; 

15 interrupting transmission if one from the group of the first control code, the 

encoded words of the first data stream, the second control code, and the 
encoded words of the second data stream are being transmitted over the 
signal line; 

transmitting the isochronous code word over the signal line; and 
20 resuming transmission if one from the group of the first control code, the 

encoded words of the first data stream, the second control code, and the 
encoded words of the second data stream are being transmitted over the 
signal line. 

54. The method of claim 47 further comprising the step of storing the 

25 encoded second data streams while the first control code and first encoded second data 
streaims are transmitted over the signal line. 

55. The method of claim 47 further comprising the step of determining a 

priority between transmitting the encoded first data stream and the encoded second 

data stream, and transmitting the encoded data stream with a highest prioritv first. 
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56. method of cUim 47 wherein the seeps of transmitting include 
converting words into a seri.i stream of bits and sequentially asserhng each bi, on the 

signal line. 

57. A method for generating a plurality of data streams from a serial 
5 sequence, the method comprising the steps of: 

converting a serial sequence of bits into a word; 
selecting a sti-eam path using the word; 
ti-ansmitting the word on the selected stream path; and 
decoding the word to produced an output word. 

10 58. The method of claim 57 wherein the step of converting the serial 

sequence further compnses the step of word aligning the converted serial sequence. 

59. The method of claim 58 wherein the step of word aligning the converted 
serial sequence, comprises the steps of: 
receiving a first word: 
15 receiving a second word; 

receiving a third word; 

shifting the first, second and third words to produced a properly aligned word 
by detecting a idle word pattern in a concatenation of the fir^t, second 

and third words. 

20 60. The method of claim 57 wherein the step of selecting a stream path 

further comprises the steps of: 

comparing the word to a set of predetermined control characters; and 
selecting a stream path associated with the one of the set of predetermined 
conti-ol characters that the word matches. 

25 61. The method of claim 57 further comprising the step of storing the word 

a^ter the step of transmitting the word on the selected stream path and before the step 
of decoding the word to produced an output word. 
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62. The method of claim 57 wherein the step of decoding converts the word 
from a 10-bit value to an eight bit value. 

63. The method of claim 57 further comprising the steps of: 

storing the word before the step of transnutting the word on the selected stream 
path 

providing access to stored word; and 

decoding the word if the word is an isochronous word. 
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